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Abstract 

We show how to generate an expression for the number of fc-hne 
Latin rectangles for any k. The computational complexity of the re- 
sulting expression, as measured by the number of additions and mul- 
tiplications required to evaluate it, is on the order of n^^ \ These 
expressions generalize Ryser's formula for derangements. 



1 Was sind und was sollen die lateinische Recht- 
ecken? 

Let S he a. set with n elements. A k-hj-n matrix (Aij) whose entries are 
drawn from the set S is called a Latin rectangle if no row or column of A 
contains a duplicate entry. Since the length of a row of the matrix A equals 
the size of the set S, each row must be a permutation of the set S. We could 
thus have described a Latin rectangle as a k-hj-n matrix whose rows are 
mutually discordant permutations of the set S. 
Examples: 

/ a b c 
b c a 
\ c a b 
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/ a c b e d \ 
b a d c e \ 
\ e b a d c ) 

The first example is a Latin square. Latin squares were investigated by 
Euler and are actually pretty interesting, as they are related to questions 
about finite projective planes. (See Ryser [3].) Latin rectangles are perhaps 
not so interesting, but they have the advantage of being easier to deal with. 

Why Latinl Because, following Euler, we have chosen our set 5* to consist 
of letters from the Latin alphabet. If we had used Greek letters instead we 
would have had Greek rectangles: 



/ a 




7 


7 


a 






7 


a 



a (3 5 \ 
l3 a 5 'y I 

If, like Euler, we were to superimpose a Greek square and a Latin square, 
and if there were no repeated entries in the resulting square, then we would 
have our hands on a really interesting object called a Graeco-Latin square: 

/ aa (3b 7c \ 

76 ac (3a 
\ (3c 7a ab ) 

Many cheerful facts about such squares can be found in Ryser's book. 

This being said, we immediately abandon the quaint custom of using 
letters for entries, and take for our n-element set S the integers from 1 to n: 

(iiD 

/ 1 3 2 5 4 \ 

2 14 3 5 
V 5 2 1 4 3 ; 

Finally, we distinguish among all Latin rectangles those whose first row 
is in order. We call such rectangles reduced. 
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Examples: 



/ 1 2 3 
2 3 1 
V 3 1 2 



) 



( 



1 2 3 4 5 6 
6 5 4 3 2 1 



) 



Any Latin rectangle can be reduced by permuting its columns, so that e.g. 
the unreduced 3-by-5 rectangle above gets reduced to 



Our object will be to find an expression for the number of A;-line Latin rect- 
angles. When we have done this we will say that we have "enumerated /c-line 
Latin rectangles." 

Let us try to be more specific about what we mean by this. When we talk 
about "A;-line Latin rectangles," the implication is that we are thinking of k 
as fixed and n as variable. To indicate this we denote the number of k-hj-n 
Latin rectangles by Lk{n). When we talk about "the number of A;-line Latin 
rectangles", we really mean the function L^. And when we say that we want 
to "find an expression for the number of A;-line Latin rectangles," what we 
are looking for is an expression involving the variable n whose value upon 
substitution for n coincides with Lk{n). 

Contrast this with the problem of enumerating (just plain) Latin rectan- 
gles. If this were our object we would denote the number of k-hj-n Latin 
rectangles by L{k, n) to indicate that we were thinking of both k and n as 
variable, and we would look around for a single expression involving both k 
and n whose value upon substitution for k and n would coincide with L(A;, n). 

Obviously if we could enumerate Latin rectangles we could enumerate k- 
line Latin rectangles for any k. Surprisingly, the converse of this statement is 
false. Thus, while we will be able to generate expressions for for any A;, and 
while it will even be clear how to write a computer program to generate these 
expressions, we won't even have come close to enumerating Latin rectangles. 
This has to do with the dependence of the expressions for Lk on k. If we tried 



/ 1 2 3 4 5 
2 4 15 3 
V 5 1 2 3 4 



) 



2 The problem 
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to get around this by incorporating the process of generating the expression 
for Lfc into a single expression involving k and n, we would find that the 
resulting expression was "not quite the kind of expression we had in mind 

At this point it would behoove us to say exactly what kind of expression 
we do have in mind. If we refrain from doing so, it is doubtless because we're 
not really too clear on this point. Obviously certain expressions are no good, 
e.g. 

J2 Xr 

iJe{l,...,n}{i"-"'=>xfl'---'"> 

where 




1 if i? is Latin 
if not 



This example suggests one criterion we will expect an expression to meet, 
namely, that it take fewer operations to evaluate the expression than it would 
take to "check all cases." Other criteria also suggest themselves, but nothing 
definitive. In any case the formulas we will produce for turn out to be of 
an obviously "acceptable" form, so there is no need to go further into this 
question here. 

In generating these formulas, our approach will be to generalize a formula 
for L2 given by Ryser. I have recently learned that a fellow named James 
Nechvatal has also come up with formulas for the number of fc-line Latin 
rectangles (Nechvatal [2]). Nechvatal's method was quite different from the 
method we will be using, and the formulas he obtained bear no resemblance 
to ours. 

Actually the formulas we will derive are formulas for Rk{n), the number 
of reduced Latin rectangles, not formulas for Lk{n). This is sufficient because 
Lk{n) = n\Rk{n). 

3 Ryser's formula for derangements 

A reduced 2-by-n rectangle is called a derangement, as it represents a per- 
mutation without fixed points. 
Example: 

1 2 3 4 5 \ 
5 3 1 2 4 j 
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We can determine the number D{n) = R2{n) of derangements by begin- 
ning with the set of all permutations of the set {1,2, ... ,n} and "including- 
excluding" on the set of fixed points. (For a description of the method of 
inclusion-exclusion see Ryser [3].) Here's what we get: 

D{n) = total number of permutations of {1,2,. . . ,n} 
— ^ number of permutations fixing i 

{i} 

+ ^ number of permutations fixing i and j 

s. (n 

= nl — n[n — 1)! + I 

- . . . + 

We write the formula in this way to emphasize that the ratio D{n)/n\, 
which represents the probability that a randomly selected permutation of 
{1,2, ... ,n} turns out to have no fixed points, is approaching 

1_ _ 1 

1!^2! 3!^'"~e' 

This formula for derangements has much to recommend it. However, 
in our enumeration we are going to be generalizing not this, but a second 
formula for the number of derangements: 





r=0 



D{n) = J2{-1Y ( ]in- rY{n ^ r ~ 1] 



This second formula, due to Ryser, is also obtained from an inclusion-exclusion 
argument, though this new argument differs substantially from the argument 
above. In the next few sections we will present Ryser 's argument, not pre- 
cisely as he presents it, but rather with an eye to generalizing it to rectangles 
with a larger number of rows. 
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4 Another way of looking at Latin rectangles 



We begin by changing our conception of a Latin rectangle. To this end, let 
(Aij) be a k-hj-n Latin rectangle, and let 



2. J2j Siji < 1 (no repeats in a row); 
3- J^i.Siji < 1 (no repeats in a column). 

Conversely, any 0-1 valued "tensor" with these three properties arises from 
a Latin rectangle in this way. This gives us a new way of looking at a Latin 
rectangle. 

If we think of taking a k-hj-n-hj-n block of cubes and selecting a subset 
of them of which Siji is the characteristic function, then we can rephrase 
conditions 1-3 above as follows: 

1. there is exactly one block on any shaft; 

2. there is at most one block on any hall; 

3. there is at most one block on any corridor. 

The terms "hall" , "corridor" , and "shaft" used here are illustrated in Figure 
[U They come from imagining our pile of blocks to be a hotel, as in Figure 
121 In the future we will frequently use this picture as a source of descriptive 
terminology. Thus e.g. when we talk about rooms at the back we will mean 
those cubes whose i-coordinate is 1, and when we say that two rooms are 
not on the same floor we will mean that they have different /-coordinates. 

5 The idea behind the enumeration 

Besides conditions 1-3 above there are a number of other similar ways of 
making sure that a selection of rooms determines a Latin rectangle. For 
instance when k = n, so that we are talking about Latin squares, we can 
phrase the requirement in the following more symmetrical way: 




Evidently 



1 



J2i Siji 
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Figure 1: A shaft, a hall, a corridor. 




Figure 2: The Latin Hotel. 



• there is exactly one room on any shaft, hall, or corridor. 

In the case of a general rectangle, we will find it helpful to phrase the 
requirements as follows: 

• there is exactly 1 room on any shaft; 

• there is at most 1 room on any corridor; 

• there is at least 1 room on any hall. 

The idea will be to look at those configurations of rooms satisfying the 
first two conditions but possibly violating the third. For lack of a better term 
we will call such configurations lonely-hall configurations to indicate that 
there may be some halls that are not represented by our selection of rooms. 
The number of Latin rectangles is the number of lonely-hall configurations 
for which this term is a misnomer, i.e. for which the set of omitted halls 
is empty. We determine this number by inclusion-exclusion on the set of 
omitted halls. 

Actually, the description just given does not quite fit what we are going 
to do, for in order to simplify our final formulas we will want to enumerate 
only reduced rectangles. Thus we will wind up looking at only those lonely- 
hall configurations having the standard "reduced" selection from the back 
halls, as shown in Figure [31 We will call such configurations reduced lonely- 
hall configurations, though it should be noted that it will not usually be 
possible to reduce an arbitrary lonely-hall configuration to a "reduced" one 
by interchanging columns. 
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Figure 3: View of the back halls for a reduced lonely-hall configuration. 

Again, we will want to use inclusion-exclusion on the omitted halls, but 
this time there will be no need to include the rear halls in the computation, 
as these will always be filled. 

6 Derivation of Ryser's formula 

In the case k = 2 we will only have to account for the n front halls in our 
inclusion-exclusion. To carry out the argument we ask ourselves: 

• how many reduced lonely-hall configurations are there in all? Answer: 



• of these, how many avoid a given front hall? Answer: {n — l){n — 2)"~^ 

• how many avoid two given front halls? Answer: {n — 2)^(n — 3)"~^ 

• etc. 

By inclusion-exclusion we get the number of selections leaving none of the 
front halls empty: 



(n-1) 



n 



D{n) = R2{n) = ' ){n- ry{n - r - 1) 



r=0 




n—r 



This is Ryser's formula for derangements. 
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Figure 4: The parameters Sqo, Sio, Sqi, Su. (Only the front and middle halls 
are shown.) 

7 The number of 3-line Latin rectangles 

In the case = 3 we will have to include-exclude over halls at the front 
and middle of the hotel. Again what we need to know is the number G{S) of 
lonely-hall configurations omitting a specified set S of front and middle halls. 
This number no longer depends only on the size of the set S. It turns out 
instead to depend on the four parameters sqo, sio, sqi, sn defined as follows: 

500 = the number of floors for which neither the 

middle nor the front hall belongs to S; 

510 = the number of floors for which the middle 

but not the front hall belongs to S; 

501 = . . . the front but not the middle . . . ; 

511 = . . . both the front and the middle .... 

This notation is illustrated in Figure |H 

Of course when n is fixed only 3 of these 4 quantities are independent, 
since 

■Soo + Sio + Sqi + Sii = n. 
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Because G{S) depends only on {sqq, Siq, Sqi, Su) we can write the inclusion- 
exclusion formula in the following form: 

s 

soo+sio+soi+sii=n VOO, Sio, Soi, SnJ 

All that remains to be done to finish the enumeration is to find an ex- 
pression for the function G. We have been claiming that G{S) depends only 
on (soo, sio, soi, sii) but in order not to get ahead of ourselves let us back off 
and think about how we would go about determining G{S) if we didn't know 
this. 

We are trying to determine the number of reduced lonely-hall configura- 
tions omitting all the halls in S. We can imagine that such a configuration 
is generated in the following way: We walk along the sidewalk in front of 
the hotel, and every time we sec a new shaft of rooms towering above us we 
pick a room from that shaft and from the middle shaft directly behind it. 
As we pick these two rooms we make sure that our choices avoid the halls in 
S. and that together with the room in back already selected they represent 
3 different floors. Evidently the n pairs of choices we make as we walk along 
may be made independently of one another. This means that G{S) can be 
written as the product of n factors representing the number of choices we 
have in picking the n pairs of rooms. 

In fact, if we weren't always having to worry about whether our choices 
interfere with the room already chosen in back we could write G{S) as an 
nth power. The complication presented by the room in back is the price we 
have to pay for choosing to count reduced rectangles. We can try to repress 
this complication by pretending, as we choose each pair of rooms, that the 
set of halls we are trying to avoid is not S but 

T = S U {halls on the same floor as the room already chosen in back} . 

Then our problem reduces to determining the number g{T) of ways of picking 
a front hall and a middle hall, not on the same floor, neither belonging to T. 
But this is easy: 

9{T) = (too + tio)(ioo + ^oi) — ^00 
(choose the front room; choose the middle room; chuck the mess-ups). 
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Of course to go back from here and write down an expression for G{S) we 
have to face up to the fact that the set T keeps changing as we proceed along 
the sidewalk. Luckily for us, while we may see as many as n different sets T 
in the course of our walk, we will see at most four different parameter sets 
(^00, ^10, ^01, ^ii)- Since g{T) depends only on these parameters, this enables 
us to write the following expression for G{S): 

G{S) = g{soo — 1, Sio, Sqi, Sii + l)^"°g{sQQ, SiQ — 1, Sqi, Sii + 1)^^° 

■ g{soo, Sio, Soi - 1, Sii + l)'*"'5((soo, Sio, Soi, Sii)'". 

As promised, G depends only on (sqo, sio, sqi, sh). 

Plugging our expression for G into the inclusion-exclusion formula above, 
we arrive at last at an expression for the number of 3-line Latin rectangles: 



This expression, for which we have struggled so valiantly, could hardly be 
called beautiful. Far prettier expressions for the number of 3-line rectangles 
are known. (Cf. Ryser [3], Bogart [T].) Its virtues are that it extends Ryser's 
formula for derangements, and that it does so in such a way as to make clear 
how to extend the enumeration to taller rectangles. 

Before we take on higher values of /c, let us say a few words about the 
computational complexity of the expression just obtained. We have expressed 
i?3(n) as a triple sum. (It appears to be a 4- fold sum, but only 3 of the indices 
are independent.) Expanded out this sum has on the order of rr" terms. A 
single term can be evaluated by performing a constant number of additions 
and something on the order of n multiplications. Thus the whole expression 
can be evaluated by performing something on the order of rt^ additions and 
multiplications. 

8 Bigger values of k 

At this point it should be clear how to write down an expression for Rk{n) 
for any value of k. Here, for example, is the expression we would obtain for 



soo+sio+soi+sii=n V-SOO) ^10, Sqi, ShJ 

■ g{soo - 1, sio, soi, sii + l)'''"'5f(soo, sw - 1, soi, su + 1) 

■ 9(^00, Sio, ^01 — 1, Su + lY°^g{soo, Sio, Sqi, Sh)'*". 




where 



5^(^005 ^105 ^Ol5 ^ll) — (^00 + ^io)(^oo + ^Ol) ^ ^00- 
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the number of 4-line rectangles: 



R^n) 



SOOO+SlOO+S010+«001+---+Slll=" 



■ fi'4('S000 -Sill + 1) 



E (-1) 




SOOO; • • • ; -Sill 



n 



] 



where 



94:{tooo, • • • , till) 



/1/2/3 ^ /l,2/3 



/2,3/l ~ /l,3/2 + 2/1,2,3 



where 



/l — ^000 + ^010+^001 + ^011) 
/l,2 = ^000 + ^001, 
/l,2,3 = ^000) 



and symmetrically for /a, /s, /2,3, /i,3- 

Note that in writing down the expression for ^'4(^000, • • • ,^111) we have 
done a Mobius inversion in the lattice of partitions of a 3-set. Looking 
back at our expression for 5f3(too, • • • , ^ii), which we referred to simply as 
5'(toO) • • • ) ^11)) we see that that formula was obtained by a surreptitious 
Mobius inversion in the (3-element) lattice of partitions of a 2-set. Natu- 
rally to write down the formula for Rk{n) we will need to know the formula 
for Mobius inversion in the lattice of partitions of a (/c — l)-set. Otherwise 
the procedure is completely straight-forward. 

The expression we come up with will be a (2^"^ — l)-fold sum containing on 
the order of terms. [Editor's note: The scanning software substituted 

"suck" for "sum" in the sentence above.] To evaluate each term will again 
take on the order of n multiplications and a constant number of additions. 
Thus it will be possible to evaluate the expression by making on the order of 
n^"^ ^ additions and multiplications. 



By now two things are clear: 

• We could, if we wanted to, write a computer program that would ask 
for a value of k and respond by printing out an expression for Rk{n). 



9 So what? 
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• We are not likely to want to do this. 

The reason is that the expression for i?3(n) is bad enough, the expression 
for i?4(n) is even worse, and the expressions get uglier and uglier at an 
exponential rate as k increases. 

But while we are not likely to put these formulas under our pillow when 
we go to bed, we have at least shown that expressions for the number of 
/c-line Latin rectangles can be found. And in the process we have gotten an 
idea of the computational complexity of the function Lk{n). 

10 Formulas for non-reduced rectangles 

In our enumeration we chose to include-exclude over reduced lonely-hall con- 
figurations in order to reduce the complexity of the resulting formulas. At 
this point it may be worth while to go back and use our original idea of 
including-excluding over all lonely-hall configurations, just to see what hap- 
pens. Here's what we get: 





• [(soo + sio)(soo + Soi) - Sii]", 




■ [/1/2/3 ~ /l,2/3 ~ /2,3/l — /l,3/2 + 2/1,2,3] "5 



where 




"SOOO + -SoiO + "SoOl + "Soil) 

sooo + -Sooi, 



-SOOO; 



and symmetrically for /a, /s, /2,3, /i.a- 
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These formulas, while perhaps in some way less "complicated" than the 
formulas for Rk, arc much more complex. Whereas the expression for 
could be evaluated by making on the order of n*^^ •* additions and multipli- 
cations, the formula for is going to require more like n^"^ •* additions and 
multiplications. 

Not that we're likely to be using either of these sets of formulas to make 
actual computations. When you come right down to it, no one really wants 
to know how many k-lme Latin rectangles there are anyway. 
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